AD-A202  932 


Jfnc  riLt  f.OP»' 


DOT/FAA/CT-88/25.  I 

FAA  Ttehnieal  Center 

Atlantic  City  International  Airport 
N.J.  08405 


Controller  Evaluation  of  Initial 
Data  Link  Air  Traffic  Control 
Services:  Mini  Study  1, 
Volume  I 


Nicholas  J.  Taiotta  et  al. 


OTIC 

:;lecte 

•IAN  2  6  1989 


September  1988 
Final  Report 


This  document  is  available  to  the  U.S.  public 
through  the  National  Technical  Information 
Service,  Springfield,  Virginia  22161. 

D  IS*i'y  IB  UTIO^  ST.*i’I^'j^vrTT  A  ' 

Approved  for  pubHc  reiea.iJT 
I  Pirtyutiog  Unlimited 

o 

US  Deportment  of  lonsponolton 

fWMiw  MfKnlOn  MBBlaraMIUIIOn 


1  25  093 


1 


NOTICE 

This  document  Is  disseminated  under  the  sponsorship 
of  the  U.S.  Department  of  Transportation  in  the  interest  of 
information  exchange.  The  United  States  Government 
assumes  no  liability  for  the  contents  or  use  thereof. 

The  United  States  Government  does  not  endorse 
products  or  manutecturers.  Trade  or  manufecturers' 
names  appear  herein  solely  because  they  are  considered 
essential  to  the  objective  of  this  report 


L 


Tachnicai  Rafwt  Baca— «aH—  Pa«a 


1*  N«. 

DOT/FAA/CT-88/25,  I 

3.  Oaaaw— a—  Aacaaai—  N*. 

3.  N«. 

4.  Till*  anO  Stiblitl* 

CaXTROLLER  EVALUATION  OF  INITIAL  DATA  LINK 

AIR  TRAFFIC  CONTROL  SERVICES:  MINI  STUDY  1, 

VOLUME  I 

4.  Faria— iaf  OrtaniiaM—  Ca4a 

ACr-170 

t.  Fariaranao  Orfaniioti—  Ra— ct  Na. 

DOT/FAA/CT-88/25,  I 

7.  t) 

Nicholas  J.  Talotta,  et  al. 

9.  Parfenniag  OrfanitaitM  Nsm  tmd  A44rat« 

Federal  Aviation  Administration 

Technical  Center 

Atlantic  City  International  Airport,  N.J.  08405 

10.  «a<4  Unit  Na.  (TRAIS) 

11.  Cm— Ml  ar  Cr— 1  No. 

T2001B 

IS.  Ty— a(  Raoari  anO  FariaO  CavaraO 

Final  Report 

1 3.  So— aarlm  Af— «y  Nai—  —4  A44ta*a 

DOT  Federal  Aviation  Administration 

Airborne  Collision  Avoidance  and 

Data  Systems  Program 

Washington,  D.C.  20590 

IS.  SuoolaaMMtory  Nataa 

Authors  who  have  made  a  significant  contribution  to  this  report  are: 

Dr.  Clark  Shingledecker,  NTI,  Thomas  Zurinskas,  ACD-320,  Dr.  Karol  Kerns,  MITRE, 

Henry  R.  Marek,  ACD-320,  William  Van  Canpen,  MITRE,  Bruce  Rosenberg,  ACN-130. 

14.  Aba>ra«« 


This  report  details  the  results  of  Mini  Study  1.  This  mini  study  was  cxjnducted  at 
the  Federal  Aviation  Administration  (FAA)  Technical  Center  utilizing  the  Eiata  Link 
testbed.  Initial  Data  Link  air  traffic  control  services  were  evaluated  under  part 
task  simulation  conditions  in  order  to  identify  service  delivery  methods  which 
optimize  controller  acceptance,  perfornance ,  and  workload.  This  report  delineates 
the  results  for  the  first  of  two  mini  studies  and  a  research  and  development 
operational  evaluation  which  coirprise  the  Phase  I  Data  Link  services  package, 


13.  Kay  War4t 

Data  Link 

Air  Traffic  (Control  Services 
■Mini  Study 

Mode  S 

II,  OlairiboM—  Stataai— t 

This  document  is  available  to  the  U.S. 
public  through  the  National  Technical 
Information  Service,  Springfield,  Va.  22161 

19.  Sacunty  CUtflil.  {•!  *fiic 

Unclassified 

30.  Saavrify  Claaail.  (a)  iMt  oof*) 

Unclassified 

31.  Na.  al  Fayaa 

37 

33.  F.ica 

Form  DOT  F  1700.7  (<-73) 


RaoroAMtioM  •#  Ml*  owAorltoW 


PREFACE 


This  report  documents  the  first  Federal  Aviation  Administration  ocartroller 
evaluation  of  a  grocp  of  three  en  route  air  traffic  control  services  planned  for 
iitplementation  on  the  Mode  S  Data  Link  ^stan.  The  r^xort  is  organized  in  two 
volumes. 

Volume  I  contains  the  main  boc^  of  the  report.  This  inclixtes  a  detailed  descriptiai 
of  the  objectives  of  the  stuc^  and  of  the  technical  approach  and  test  methods  that 
were  used.  In  addition,  the  ocnbined  results  of  the  stuc^,  oonclusiois,  and 
reocmmendaticxis  are  presented. 

Volume  II  is  oonprised  of  a  set  of  seven  c^pendixes  to  the  report.  These  appendixes 
are  referenced  in  Volvime  I  and  include  ocnplete  documentation  of  the  test  scenario 
and  of  the  assessment  procedures  used  in  the  stu^.  Separate  appendixes  are  adso 
devoted  to  detailed  analyses  of  the  data  that  were  collected  using  each  of  the 
assefisment  procedures.  These  appendixes  formed  the  baisis  for  the  ocnbined  results 
por^-ion  (secticn  3)  of  Volume  I. 

This  regxsct  delinentes  the  results  for  the  first  of  two  mini  studies  and  a  Research 
and  Development  Cperational  Evaluation  -  all  of  which  ocnprise  the  Phase  I  Data  Link 
Services  package. 
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EXECUTIVE  SUIWARY 


INTRODUCnca^. 

The  FecJeral  Aviation  Administration  (EAA)  Test  Plan  for  the  Mode  S  Data  Link 
defines  a  two-stage  process  for  ocxitroller  eveduatioi  of  candidate  air  traffic 
CX3ntrol  (ATC)  services.  In  the  first  stage,  ••mini”  design  studies  will  be 
conducted  under  controlled  conditicais  which  simlate  CTily  the  essential  ccmponents 
of  the  ccaTtroller's  tasks  associated  with  the  services  (Part  Task  Simulation) . 
These  studies  will  be  used  to  identify  service  delivery  methods  vhich  t^imize 
controller  acx:^xtance,  performance,  and  workload.  In  the  seccaid  stage,  full-scale 
simulation  studies  will  be  performed  in  order  to  verify  the  safety  and  efficiency  of 
Data  Link  within  the  context  of  reeilistic  operationed  scenarios.  This  r^)ort 
presents  the  results  of  the  first  EAA  controller  mini  stucfy  of  en  route  ATC 
services  developed  for  implementation  an  the  Data  Lirik  system. 


OBJECTIVES. 

The  specific  objectives  of  this  mini  stuc^  were:  (1)  to  evaluate  emd  refine  Data 
Link  ocxitroller  prooeciures  and  di^lays  for  the  Altitude  Confirmation,  Transfer  of 
COnnraunic^tion,  and  En  route  Minimum  Safe  Altitude  Weuming  (EMSAW)  services,  and  (2) 
to  solicit  initial  opinions  from  cxaTtrollers  iregarding  the  general  utili^  of  the 
Mode  S  Data  Link. 

DATA  LINK  OPERATIC^T. 

Data  Link  functions  were  integrated  with  the  Host  Ocnputer  System  (HCS)  c^ierational 
software  and  the  Ocnputer  Display  Channel  (CUC)  displays.  Capabilities  included 
radar  cJata  processing,  tracking,  and  fli^t  data  inputs.  Operaticxial  Data  Link 
functions  ana  prcxoedures  were  integrated  with  cxirrent  cperaticxial  procoedures  and 
oonputer  functicxis.  Data  base  vpdates  followed  cdtitude  clearancoes;  handoffs  between 
sectors  included  radio  frecjuency  assignments;  EMSAW  eilerts  were  generated  ipon  HCS 
notificaticn;  and  altimeter  settings  were  automatically  uplinked. 

Two  inodes  of  operation  were  evaluated,  manucd  and  automatic.  In  automatic  mode,  a 
Data  Link  message  was  initiated  and  di^ivered  via  standard  National  Airspacoe  System 
(NAS)  entries.  The  message  was  di^layed  to  the  coontroller  as  ”sait''  (transmitted 
to  aircraft  transponder) ,  "delivered"  (received  by  the  aircraft  tran^xonder) ,  and 
"wilco"  (pilot  affirmative  r^ly) .  In  manual  mode,  the  status  indication  "held"  was 
displayed  beside  the  message  that  appeared  in  the  preview  area:  Plan  View  Display 
(PVD)  or  Computer  Readout  Device  (CRD) .  Another  sequence  of  entries  resulted  in  the 
message  triggering  the  "sent,"  "delivered,"  and  "wilco"  status  indicators  as 
appropriate.  No  pilot  conposed  downlink  were  tested.  Pilot  "unable"  and  no  r^ly 
("timeout")  conditions  were  also  tested. 


APPROACH. 

Ten  full-performance  level  air  traffic  controllers  from  Dallas/Fort  Vforth  (D/EW) 
participated  in  the  study  as  subjects  and  observers  in  a  series  of  ATC  scenarios 
presented  at  work  stations  at  the  FAA  Technical  Center  Data  Lirik  test  bed.  In  order 
to  permit  the  evaluation  of  Data  Link  oonc^>ts  without  distracting  or  overburdening 
test  participants,  test  scenarios  were  limited.  There  were  few  tracks  and  no 
interfacility  activity.  Traffic  flows  were  repetitious  in  nature  and  oaitrol  tasks 
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vere  restricted.  No  overall  system  delays  were  simolated.  Figure  ES-1  projects  the 
expected  workloeKl  for  a  Data  Link  envircnnent  in  cxx()arisGn  to  present  ATC  field 
cxxiditions. 

Initially,  the  scenarios  required  the  controllers  to  ccnplete  several  altitude 
assignmenVoonfirnation,  transfer  of  cxxntunicaticns,  and  EH5AN  tasks,  varying  the 
di^lays  procedures  used  to  acocnplish  the  three  services.  Both  csentral  (IVD) 
and  peripher^d  (CSD)  locations  were  tested  for  the  Data  Link  transaction  status 
diq>lay.  Various  ATC  procedures  were  also  evzduated  which  differed  in  the  nunnber  of 
cxntroller  actions  required  to  deliver  the  services,  the  requirements  for  voic» 
interactions  between  the  cmtroller  and  the  pilot,  and  the  requirement  for 
downlinked  pilot  cxeifimation  of  service  message  delivery. 

Following  each  test  condition,  the  subjects  rated  the  wc^kload  that  would  be 
induced  by  the  tested  options  under  operational  conditions.  The  technique,  ceaied 
projected  subjective  workload  assessment  technique  (HXSWAT) ,  asked  the  controller 
to  project  the  effect  of  each  test  condition  on  the  difficult^  of  their  job  during  a 
moderately  busy  workday.  A  scx>re  of  0  (low  workloEKi  effort)  to  100  (very  hi^ 
worklcsad  effort)  was  derived  through  a  conjoint  analysis  of  IROSNAT  ratings.  Ihis 
technique  results  in  interval  data  capable  of  being  analyzed  by  parametric  means. 

Another  rating  scede  was  used  after  each  condition  to  assess  controller  preferences 
for  each  condition.  In  addition,  these  formal  data  were  supplemented  by  group 
d^riefing  interviews,  a  wrapn:p  ^jestionnaire,  and  written  narrative  ccnments 
following  the  test  sessions. 


General  opinicns  of  Data  Link  were  strongly  positive.  A  majority  of  the  controller 
subjects  felt  that  Data  Link  would  definitely  reduce  controller  workload  and  enhance 
ATC  system  ce^city  emd  safety.  Whereas  the  findings  were  positive,  it  should  be 
noted  that  the  aquired  data  are  preliminary  and  that  the  sim^ation  environment  and 
scenarios  were  limited  with  respect  to  ATC  operations  in  this  mini  study. 

Ihe  ^lecific  results  of  the  study  clearly  show  that  the  suli^ects  preferred  the  Data 
Link  message  preview  area  in  the  IVD  rather  than  the  CKD  di^lay.  All  subjects  felt 
that  Data  Link  transaction  status  information  should  be  displayed  in  a  position  that 
does  not  distract  the  controller's  attention  frcm  primary  radar  data.  Furthermore, 
because  tlie  list  format  of  this  display  may  beocme  difficult  to  monitor  vhen 
nultlple  aircraft  and  services  are  presented,  the  subjects  indicated  that  further 
inprwements  may  be  achieved  with  key  transaction  data  indications  in  the  full  data 
block  (FIB) .  Ihe  positive  re^xsnse  to  Data  Link  FDB  utilization  suggests  strongly 
that  this  function  should  be  included  in  subsequent  ev2duations.  This  capability 
was  not  tested,  implemented,  or  evaluated  in  this  mini  study. 

In  general,  automated  procedures  produced  lower  workload  and  higher  preference 
ratings  than  those  which  required  the  subjects  to  manually  initiate  tplinks  and 
delete  cxxrpleted  transactions  frcm  the  display  (see  figure  B5-1) .  However, 
controllers  also  indicated  that  a  manual  option  to  inhibit  automated  iplinks  per 
controller  action  should  be  available.  This  inhibit  option  would  control  whether  a 
me882ige  would  be  sent  to  pilot  only,  NAS  ocnputer  only,  or  both.  The  subjects 
suggested  that  it  should  be  possible  to  exercise  such  proactive  control  over  vplinks 
by  sector,  service  type,  and  individuad  transaction. 


Altliou^  the  cxxTtinued  availability  of  a  reliable  voice  radio  channel  was 
considered  essential,  voice  ccnnunicatiGns  between  the  pilot  and  controller  were 
redundant  with  Data  Link  and  were  not  preferred  becaiise  of  increased  workload  (see 
figure  ES-1) .  In  additicxi,  some  form  of  confirmatory  pilot  response  to  a  Data  Link 
message  was  considered  mandatory  for  all  services,  and  a  dcwnlink  was  found  to  be  a 
valid  method  for  providing  this  response  under  "no  voice”  conditions. 

As  noted  earlier,  the  Data  Link  concepts  presented  in  this  stucty  received  favorable 
evaluations  from  the  subjects.  Ifcjwever,  concerns  eaqpressed  by  some  controllers 
about  the  reliability  of  the  inplementation  of  £M5AW,  with  vhich  they  were  familiar, 
and  about  the  possible  effects  of  delays  in  operational  Data  Link  transaction  times 
suggest  that  these  issues  will  require  further  attention  in  future  evaluaticai 
research. 

Oontrollers  judged  that  utilizing  an  optimum  Data  Link  configuration  for  the  three 
evaluated  services  would  have  no  negative  effects  on  subsidiary  tasks.  Such  tasks 
as  R-D  controller  coordination,  sector  interphone,  system  errors,  weather,  strip 
handling,  status  board  information,  and  keeping  the  picture  were  rated  as  not  being 
negatively  inpacted  and,  in  roost  cases,  favorably  irpacted  by  Data  Link  ce^ability. 


ReooRinendations  based  cn  the  results  outlined  above  include  a  set  of  prelimincury 
specifications  for  the  three  tested  services.  These  findings  may  change  when 
enhanced  scenarios  are  evaluated.  The  data  idmitifies  the  di^lays  and  procedures 
vhich  will  be  used  in  a  full  scale,  operational  evaluation  stuc^  of  the  services  to 
be  conducted  at  the  EAA  Technical  Oenter.  Briefly,  it  is  reccnmended  that  Data 
Link  transacticn  information  be  located  on  the  IVD,  preferably  with  a  full  data 
block  indicatic»i  of  the  Data  Link  message  status.  Automatic  tplinks  and  automatic 
message  di^lay  deletion  with  pilot  affirmation  are  eilso  suggested  with  the  option 
to  inhibit  vplinks  using  siirple  prefix  code  keyboard  entries.  After  an  initied 
familiarization  period,  redundant  voice  ocmaunications  should  not  be  used  with  Data 
Link  services.  However,  a  reliable  voice  channel  is  mandatory  for  resolving 
misunderstandings  and  as  a  backip  for  system  fedlures. 

Because  of  the  accelerated  status  of  the  Data  Link  program  and  the  definitive 
results  obtained  from  this  study,  it  is  also  reccnmended  that  a  means  be  devised 
for  providing  regular  and  continued  involvement  of  current  air  traffic  oontrollers 
in  future  Data  Link  ATC  service  design  and  evaluation  efforts. 
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1.  INTRODUCngj. 


1.1  HJRPOSE. 

Biis  dcxximent  presents  the  results  of  the  first  Federal  Aviation  Administration 
(FAA)  air  traffic  controller  evaluaticai  of  en  route  air  traffic  control  (ATC) 
services  designed  for  implementation  in  the  Mode  S  Data  Link  system.  Specific^ly, 
this  initicil  study  was  conducted  to  evciluate  controller  procedures  and  di^lays  for 
the  altitude  confirmation,  transfer  of  corarunicaticns,  and  En  Route  Minimum  Safe 
Altitude  Warning  (EMSAW)  services.  Oontroller  inputs  were  cilso  solicited  during 
this  stxK^  to  assess  the  perceived  utility  of  Data  Link  and  its  inpact  on  the  ATC 
system. 


1.2  BACK5R0UND. 

The  Mode  Select  Beacon  System  (Mode  S)  is  a  secondary  surveillcmce  radar  vdiich  will 
replace  the  current  Air  Traffic  Control  Radar  Beaocai  System  (ATCRBS) .  The  ATCRBS 
uses  a  ground-based  rotating  antenna  that  transmits  continuous  radio  frequency  (RF) 
interrogations  to  which  a  transponder  equipped  aircraft  will  respond.  The  relies 
provide  the  ATC  system  with  an  aircraft  identification  code  or  the  aircraft 
altitude.  Aircraft  location  information  is  provided  by  the  rotational  position  of 
the  antenna  eind  the  transponder  response  delay  at  the  time  a  reply  is  received. 

The  Mode  S  will  provide  the  same  functions  eis  the  ATCRBS,  but  will  do  so  more 
accurately  while  offering  the  additional  capability  of  transmitting  digital 
information  across  a  two-way,  air-ground  Data  Link.  These  enhancements  are 
possible  because  each  aircraft  will  be  assigned  a  unique  address  code  vdiich  will  be 
used  in  the  system's  inteirrogations  to  select  only  the  requested  aircraft  to 
respond.  The  primary  components  of  the  Mode  S  are  illustrated  in  figure  1. 

Because  of  its  flexibility  and  capacity,  the  Mode  S  Data  Link  promises  to  be  a  key 
to  increased  automation  of  the  ATC  system,  and,  therefore,  has  the  potenticil  to 
significsintly  enhcinoe  ATC  safety  end  productivity.  One  of  the  priitary  ways  in 
viiich  this  potential  will  be  achieved  will  be  throu^  the  iiipact  of  Data  Link  cwi 
the  tasks  of  the  air  traffic  controller. 

The  first  service  to  be  provided  by  Data  Link  will  be  automated  delivery  of  weather 
advisories  to  aircraft.  This  function  edcxie  will  reduce  the  cilreacfy  burdened 
controller's  task  load  by  eliminating  any  requirement  to  verbally  relay  these  data 
to  pilots  via  voice  radio.  However,  the  accelerated  Data  Link  program  also  calls 
for  the  Data  Link  to  mediate  a  variety  of  primary  ATC  services  vhich  are  currently 
accomplished  in  a  completely  manual  fashicai  using  voice  radio.  The  proposed  ATC 
services  will  include  transfer  of  oanmunications,  clearance  delivery,  inflict  plan 
amendment,  and  a  variety  of  other  interacticsTS  among  controllers,  pilots,  and 
a\2bomated  systems. 

The  study  r^xjrted  in  this  document  was  ccaiducted  as  an  initied  controller 
evaluation  of  the  first  three  en  route  ATC  services  scheduled  for  iitplementation  an 
Data  Link.  The  first  service  in  the  initicil  Data  Link  package  is  altitude 
confirmation.  This  new  service  will  transmit  digital  altitude  data  directly  to  an 
aircraft  display  after  a  new  altitude  has  been  assigned  by  the  oontroller.  The 
second  service  tested  in  this  study  was  transfer  of  communications.  This  actiai  is 
currently  accomplished  thrxxi^  voice  communication  between  the  oontroller  and  a 
pilot  following  transfer  of  control  between  sectors.  Using  Data  Link,  this  service 
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will  permit  the  transferring  cxantroller  to  send  a  digital  message  to  the  aircraft  in 
order  to  inform  the  pilot  of  the  voicae  RF  on  v*iich  the  receiving  ccntroller  will  be 
ocnrunicating.  The  fincil  service  evaluated  in  this  stufy  is  EMSAW.  Ihis  is  a 
warning  service  provided  to  pilots  by  ATC  vAien  it  is  predicted  that  predetermined 
minimum  fli^it  altitudes  will  be  violated.  Using  Data  Link,  this  service  will  be 
accccplished  sending  the  EMSAW  message  digitally  ipcai  detection  of  a  predicted 
violation,  rather  than  by  a  voice  radio  message. 

Ihe  ultimate  success  of  Data  Link  and  other  FAA  autonation  initiatives  are 
critically  dependent  the  extent  to  v^ch  these  technologies  are  employed  to 
produce  a  system  that  is  well  integrated  with  the  human  operators  vho  will  be 
required  to  control  and  sipervise  its  function.  Becairse  Data  Link  will  profoundly 
affect  the  manner  in  vMch  air  traffic  ccxTtrollers  accomplish  their  duties,  it  is 
imperative  that  service  delivery  procedures,  and  the  di^lays  and  controls  used  to 
interact  with  the  system,  are  designed  with  careful  consideration  of  their  impact  on 
the  performance  capabilities  of  the  controller.  The  intent  of  the  controller 
evaluation  study  reported  in  this  document,  and  of  future  studies  planned  for  the 
program,  is  to  insure  that  controller  workload,  performance,  and  acceptance  are  used 
as  primary  inputs  to  the  development  and  implementation  of  the  Data  Link  system. 

1.3  DftTA  LINK  TEST  BED. 

The  present  stucfy  was  conducted  in  the  Data  Link  test  bed  facility  located  at  the 
EAA  Technical  Center.  The  Data  Link  test  bed  was  assembled  to  provide  both 
engineering  testing  and  evaluation  cepabilities  for  Data  Link  services  during 
controller-in-the-locp  simulaticxi.  Figure  2  presents  a  functicxial  diagram  of  the 
main  oorponents  of  the  test  bed  and  their  interoonnectiOTs. 

During  the  simulation  study  described  in  this  report,  the  subject  controllers 
operating  at  National  Airspace  System  (NAS)  laboratory  work  stations  were  presented 
with  simulated  radar  data  and  ATC  systsm  information  from  the  Host  ocnputer.  The 
voices  and  Data  Link  inputs  of  aircraft  pilots  were  provided  by  trained  test 
personnel  serving  as  dynamic  simulation  (DYSIM)  pilots.  The  VAX  11/750  computer 
generated  all  Data  Link  outputs  and  permitted  n&dble  variaticmi  of  the  procedures 
used  to  deliver  the  services  under  evaluation. 

2.  TEST  CeSCRIFTTC^. 


2.1  OBJEXJnVES. 

The  overall  test  plan  for  controller  evaluaticmi  of  Data  Link  ATC  services  cedis  for 
research  to  achieve  two  major  objectives.  First,  the  evaluaticxi  studies  must 
determine  the  operationed  procedures  and  data  di^lay  methods  for  each  of  the 
subject  services.  Second,  these  studies  must  evzduate  the  integraticmi  of  the  Data 
Link  services  with  other  controller  duties  and  ensure  the  acceptability  of 
controller  and  system  performance  under  operational  ooiditicmis. 

These  objectives  imply  that  optimization  and  validation  of  Data  Link  ATC  services 
will  require  research  to  address  a  large  number  of  human  factors  design  variables, 
as  well  as  the  impact  of  various  operaticmvd  and  environmental  factors.  Because  the 
inclusicmi  of  all  of  these  parameters  in  a  single,  factorially  defined  study  would 
result  in  an  unmanageable  large  test  matrix,  a  two-stage  process  was  developed  for 
the  evaluation  of  Data  Link  services. 
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In  the  first  stage,  hi^ily  ocntrolled,  part-^task  sirulation  studies  will  be 
conducted  with  en  route  ccsitrollers  to  reduce  the  nunber  design  edtematives  to  a 
reasonable  set.  These  "mini"  design  studies  will  involve  the  formal  testing  of 
di^lay  and  procedural  cpticns  as  well  as  structured  interviews  designed  to  elicit 
expert  controller  opinicxis  cn  the  operatic»al  suitability  of  the  services.  The 
fomal  criteria  for  option  evaluation  will  be  measures  of  ccntroller  workload  and 
aoceptanoe. 

In  the  second  stage  of  the  evaluation  process,  operational  evaluation  studies  will 
be  perfomted  in  the  ccxitext  of  full-scale  ATC  simulation.  The  ^)ecific  gocil  of  this 
stage  will  be  to  confirm  the  optimality  of  the  design  of  each  Data  Link  service,  and 
to  verify  the  safety  and  efficiency  of  Data  Link  under  various  operational 
conditions.  Operaticsial  eveduation  studies  will  assess  overall  system 
effectiveness ,  performance,  and  controller  woxicload  within  en  route  ATC  test 
scenarios  that  present  both  ncndneil  and  hi^  levels  of  controller  task  demand. 

The  stuc^  reported  here  is  the  first  mini  study  performed  under  the  test  plan 
outlined  above.  The  primary  objective  of  this  study  was  to  reduce  the  number  of 
potential  procedural  and  display  design  options  to  an  aoo^table  set  for  use  in 
operational  evaluation  of  the  altitude  confirmation,  transfer  of  oonmunicaticMTS, 
and  EM5AW  Data  Link  services.  Because  this  mini  study  r^resented  the  first  formal 
intrxxtucrtion  of  Data  Link  to  current  en  route  air  traffic  controllers,  a  seocaidary 
objective  of  the  research  was  to  solicit  controller  opinions  regarding  the  general 
utility  and  cperaticnal  suitability  of  the  JkxJe  S  Data  Link. 

2.2  TEST  APFBCACH. 

The  £^roach  that  was  adopted  to  meet  the  objectives  of  this  mini  study  involved 
the  participaticxi  of  a  team  of  10  en  route  air  traffic  controllers  in  a  series  of 
short  ATC  scenarios  at  the  Data  Link  test  bed  work  stations.  Each  of  these 
scenarios  required  four  of  tfie  subjects  to  actively  control  individual  sectors  with 
identiced  traffic  loads.  The  scenario  script  in  each  case  contained  six  altitude 
assignment  tasks,  one  £MSAW  event,  and  twc  hand-offs  with  transfer  of 
oonnunications.  The  hi^ily  standardized  and  simplified  test  conditions  differed 
only  in  the  means  by  vhich  the  three  subject  services  were  acocnplished.  These 
methods  consisted  of  the  current  approach  without  Data  Link  (baseline) ,  as  well  as 
variations  in  the  locaticxi  of  the  Data  Link  transaction  display  and  in  the 
controller  and  pilot  actions  required  to  oonplete  a  Data  Link  transacticxi. 

During  the  test  runs,  four  additional  subjects  passively  observed  one  of  the 
controlling  subjects  as  he  ocnpleted  the  required  ATC  tasks.  Following  each  run, 
both  the  active  and  passive  controllers  were  asked  to  rate  the  projected  workload 
that  would  be  induced  by  the  tested  options  under  operational  conditions.  In 
addition,  controller  preferences  for  the  tested  opti(xis  were  elicited  after  each 
run  using  a  second  rating  scale.  These  fomal  data  were  sipplemented  by  group 
d^riefing  interviews,  a  wrap-^  questionnaire,  and  written  narrative  comments 
following  the  testing  sessions.  The  two  remaining  controllers  monitored  the  fomal 
data  collecrtion  and  participated  in  the  post-test  interviews. 

The  rationale  underlying  this  testing  approach  was  to  utilize  the  rapid 
reconfiguration  capability  of  the  Data  Link  test  bed  to  efficiently  filter-out 
untenable  design  options.  Using  both  quantified  subjective  measures  of  workload 
and  preference,  and  less  formal  interview  re^xnses,  the  object:  of  the  stuc^  design 
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was  to  produce  an  design  configuraticai  for  each  service  vhich  would  c^imize 
ccMTtroller  acceptance,  workload,  and  operational  suitability. 

2.3  TEST  CXMJUCT. 


2.3.1  Subjects. 

Ihe  subjects  for  this  study  were  10  current,  full  performance  level  (FPL)  air 
traffic  controllers  from  the  Dallas/Fort  Worth  C3enter.  Ncaie  of  the  oOTtrollers  had 
prior  ejqjerience  with  the  iitplementaticxi  options  for  the  Mode  S  Data  Link  ATC 
services  under  invest igatic»i.  All  subjects  were  volunteers. 

Of  the  10  controllers,  8  served  as  subjects  in  the  formal  test  bed  evaluatiOTi 
acting  as  passive  cperational  observers  and  active  subject  controllers.  The 
remaining  two  subjects  chserved  the  test  bed  data  collecticai  on  an  informal  basis, 
but  provided  data  only  in  the  debriefing  interview,  wrap-i^  questicxinaire,  and  final 
narrative  comments. 

The  ei^t  subjects  who  participated  in  the  formal  testing  had  an  average  of  15.7 
yeeurs  experience  as  FPL  air  traffic  ocxitrollers.  Four  of  the  subjects  had  prior 
experience  as  aircraft  pilots  (16  years  average) .  Three  of  the  subjects  indicated 
that  they  had  seme  preliminary  familiarity  with  the  Data  Link  program. 

2.3.2  DESCRIPITC^  OF  TEST  OPTICTIS. 

In  this  study,  two  basic  display  location  options  and  five  procedural  options  were 
prepared  for  controller  evaluation.  A  sixth  procedural  option  was  developed  as  a 
result  of  the  debriefing  interviews  conducted  after  Day  1  testing.  This  modified 
system  option  was  programmed  and  evaluated  during  Day  2  testing.  All  test  options 
viiich  were  exercised  in  the  experimental  design,  discussed  later  in  this  r^»rt,  are 
described  below: 

2. 3. 2.1  Location  of  the  Data  T.ink  Transaction  Display. 

The  Data  Link  system  will  provide  the  orartroller  with  a  list  di^lay  vftiich  permits 
monitoring  of  the  current  status  of  any  ongoing  service  transaction.  In  this  stuc^, 
each  line  on  the  display  provided  an  indicaticxi  of  the  service  in  progress,  the 
aircraft  receiving  the  service  (AID) ,  and  the  status  of  the  transacticxi.  The 
following  is  a  list  of  words  displayed  to  indicate  the  status  of  a  Data  Link 
transaction: 

HELD  -  Indicated  that  an  uplink  was  ready  for  transmission  (used  only  in  manual 
uplink  conditions) . 

SENT  -  Indicated  that  an  vplink  had  been  initiated. 

raiilVERED  -  Indicated  that  a  valid  iplink  had  been  received  hy  the  aircraft 
(techniccLl  acknowledgement) . 

WILOO  -  A  downlink  indicating  that  the  pilot  had  received  the  message 
and  intended  to  oonply  with  the  instruction  or  warning. 

UNABLE  -  A  downlink  indicating  that  the  pilot  was  unable  to  oonply  with 
the  message. 
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TIMEX3Ur  -  A  system  indication  that  the  pilot:  had  failed  to  reply  to  the 

i:^}linked  message  within  a  fixed  time  parameter  (60  seconds  in  this 
study) . 

TVjo  opticMTs  for  the  locaticHi  of  the  di^lay  were  tested: 

a.  On  the  Plan  View  Display  (IVD  List) 

b.  On  the  Radar  Positicn  Ocnputer  Readout  Device  (Rr<3?D  List) 

2, 3. 2. 2  ATC  Data  Link  Service  Procedures. 

Several  optioneil  Data  Link  procedures  were  used  to  deliver  the  three  initial 
services.  Ihese  differed  in  the  number  of  overt  ocntroller  actions  (data  entries) 
required  to  deliver  the  service,  the  requirements  for  voice  interactions  between  the 
controller  and  the  pilot,  and  the  requirement  for  downlinked  pilot  confirmation  of 
service  message  delivery.  Ihe  following  procedural  conditions  were  prepared  for 
presentatiOTi. 

2. 3.2.2. 1  Voice  -  Full  Manual  Control  -  pilnt  pp^poTse  RftmiiTiPrt. 

In  this  procedure.  Data  Link  entries  followed  the  normal  voice  oonnunicaticxis 
currently  used  to  assign  a  new  altitude,  inform  a  pilot  of  the  RF  for  a  receiving 
controller  after  a  hand-off,  or  warn  the  pilot  of  a  minimum  satfe  altitude  violatioi. 
Entry  of  an  altitude  amendment  to  the  system,  ocmpletion  of  a  transfer  of  control  to 
a  new  sector  or  system,  and  detection  of  an  IMSAW  event  made  the  eqppropriate  vplink 
available  for  transmissicai.  Hie  controller  manually  initiated  the  iplink  using  a 
quick  action  key  to  designate  a  Data  Link  tranmission  and  keyboard  inputs  or  the 
track  belli  (PVD  caily)  to  identify  the  e^ropriate  line  on  the  list  di^lay. 

In  cill  Ccises,  after  a  techniced  acknowledgement  (DELIVERED  status  indication)  was 
received  from  the  aircraft,  the  ocntroller  was  required  to  monitor  the  transacticn 
status  di^lay  for  a  WILOO  downlink,  indicating  that  the  pilot  had  received  the 
message  and  intended  to  cxmply.  The  status  line  on  the  Data  Link  transacticxi 
display  was  cleared  by  the  cxintroller  by  designating  the  status  line  and  maldng  a 
''delete”  entry.  In  the  c:ase  of  the  transfer  of  cxminunications,  the  di^lay  was 
cleared  ly  the  receiving  ocxitroller  after  the  hand-off  was  ocnpleted  by  the 
transferring  ccxitroller. 

2. 3. 2. 2. 2  Voice  -  Full  Manual  -  No  Pilot  ResoexTse  Required. 

This  procedure  was  identical  to  that  described  in  2. 3. 2. 2.1  with  the  eooo^rtion  that 
the  Data  Link  activity  terminated  following  receipt  of  a  technical  acknowledgement 
from  the  aircraft.  Thus,  the  controller  was  not  required  to  monitor  for  a  WILCX) 
re^xxise  from  the  pilot. 

2. 3. 2. 2. 3  Voice  -  Automatic  Control  -  Pilot  Resoca-we  P»^iiTiPd. 

This  procedure  was  identical  to  that  described  in  2. 3. 2. 2.1  with  the  excepticn  that 
the  entry  of  an  altitude  amendment,  cmpletion  of  a  hand-off  between  sectors  or 
system  detection  of  an  QBAW  event  automatically  initiated  the  e^ropriate  uplink. 
Ihus,  the  controller's  task  in  providing  altitude  confirmation,  EM5AW,  and  transfer 
of  cxnraunication  involved  no  new  manual  actions  cxitpared  to  the  current  baseline 
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system  other  than  to  delete  ocnpleted  list  entries.  However,  all  Data  Link 
transacticns  cxxitinued  to  be  redundant  with  traditional  voice  oonnunicaticais,  and 
the  controller  was  required  to  mcnitor  the  transaction  display  for  a  VfiKX)  downlink 
indicating  that  the  Data  Link  message  has  been  received  by  the  pilot. 

2. 3. 2. 2. 4  Voice  -  Autcmatic  Ooitrol  -  No  Pilot  PfirniiTiPri. 

This  procedure  was  identical  to  that  described  in  2. 3. 2. 2. 3  with  the  exception  that 
the  Data  Link  transaction  was  terminated  after  receipt  of  a  techniced 
acknowledgexaent  as  in  2. 3. 2. 2. 2. 


2. 3. 2. 2. 5  No  Voice  -  Automatic  Qmtrol  -  Pilot  Response  PtamiiriBH. 

Ihis  version  of  the  procedure  eliminated  all  voice  comnunication  between  the 
controller  and  the  pilot.  Ihus,  entry  of  an  eiltitude  amendment,  conpletion  of  a 
hand-off,  or  system  detectiexi  of  an  EMSAW  event  autonaticadly  uplinked  the 
appropriate  information  as  in  procedures  2. 3. 2. 2. 3  and  2. 3. 2. 2. 4.  Ik^wsver,  the 
vplink  was  not  redundant  with  a  voice  ccntact.  Since  this  redundancy  was 
eliminated,  a  pilot  WIIOD  downlink  was  required  to  inform  the  controller  of  pilot 
respcaise. 

2. 3. 2. 2. 6  Modified  System. 

A  final  procedural  ccxidition  tested  in  this  stu^  was  developed  as  a  result  of 
controller  suggestirais  contributed  after  testing  on  the  options  described  above. 

This  procedure  combined  features  of  the  automatic  and  manual  procedures  and 
eliminated  controller  data  entries  required  to  delete  di^lay  list  lines  for 
corpleted  transactions.  Receipt  of  a  WILOO  message  automatically  deleted  list 
entires.  In  addition,  the  transfer  of  ccnnunications  procedure  was  redesigned  so 
that  the  uplink  was  under  the  control  of  the  transferring  controller.  Transfer  of 
conmunications  messages  were  also  di^layed  in  the  Data  Link  list  for  both  the 
sending  and  receiving  sectors.  Manual  control  of  the  transfer  of  conraunicaticns 
vplink  was  used  in  order  to  permit  independent  control  over  the  hand-off  and  the 
transmission  of  a  new  RF.  Automatic  control  was  used  for  the  edtitude  confirmation 
and  EM5AW  services. 

2.3.3  Test  Scenario  Description. 

The  test  scenario  created  for  this  mini  study  consisted  of  a  hi^Hy  constrained  ATC 
situation  designed  to  focus  on  the  three  services  under  evaluation.  Four  separate 
Universed  Data  Set  (UDS)  sectors  were  simulated,  with  two  sectors  involved  in  hi^ 
altitude  control  and  two  sectors  involved  in  lew  altitude  control.  Each  sector 
contained  three  aircraft  moving  through  its  air^ce  during  the  10-minute  scenario. 
Each  of  the  three  aircraft  received  only  one  of  the  three  services  under  evaluation. 
No  other  ATC  events  occured  in  the  scenario. 

The  scenario  script  included  six  edtitude  assignment  events,  one  EMSAW  event, and 
two  handoffs.  Handoff  events  took  place  between  sectors  contained  in  the  overall 
scenario  so  that  each  active  ccntroller  transferred  and  received  control  of  two 
aircraft  during  a  single  test  run.  All  transfer  of  ocRKunications  and  EMSAW  Data 
Link  transactions  occurred  with  successful  technical  acknowledgement  and  WIKD 
responses.  However,  in  order  to  examine  the  impact  of  potentied  variations,  only 
four  of  the  edtitude  confirmation  events  proceeded  successfully.  The  remaining  two 


resulted  in  a  system  timeout  for  the  pilot  respcaise  or  a  pilot  "vinable”  response  to 
the  altitude  oonfirmation  message.  Ihe  scripts  used  to  direct  ocntroller  and  pilot 
activities  in  eadi  sector  are  contained  in  e^]pendix  A. 

2.3.4  Test  Procedures. 

This  mini  study  was  conducted  over  a  4-day  period.  The  first  2  days  were  used  for 
subject  familiarization  and  training,  while  the  last  2  days  (Day  1  and  Day  2 
testing)  were  used  for  all  data  collection. 

The  first  familiarization  day  was  devoted  to  a  2-hour  series  of  briefings  designed 
to  acquaint  the  subject  ocaitrollers  with  the  Data  Link  concept  and  the  test 
conditions.  Individual  briefings  included:  (a)  an  introduction  to  the  Data  Link 
program  and  the  Data  Link  test  bed,  (b)  a  description  of  the  test  scenario  and  the 
options  to  be  evaluated  for  each  service,  (c)  a  presentation  of  Data  Link  Host 
operations  and  the  procedures  used  for  interacting  with  Data  Link,  and  (d)  the 
functions  that  would  be  served  by  various  test  personnel. 

On  the  second  day,  the  subjects  received  a  briefing  can  the  workload  and 
preference/aoc^jtability  rating  sccdes  to  be  used  during  formal  data  collection. 
This  2-hour  session  included  oonpletion  of  the  projected  subjective  workload 
assessment  technique  (FK3SWAT)  card  sort  task  by  each  OCTitroller.  The  object  of 
the  card  sort  task  was  to  collect  the  data  required  to  tailor  the  quantitative 
interpretation  of  workload  ratings  to  the  concepts  of  workload  held  by  individual 
controllers. 

After  the  card  sorting  task  was  oonplebed,  the  subjects  were  taken  to  the  Data  Link 
test  bed  for  hands-on  training.  The  2-hour  training  session  included  five  practice 
runs  using  the  scenario  constructed  for  the  data  collection  sessions.  The  five 
practice  nms  were  conducted  under  baseline/current  system  omditions  and  under  two 
of  the  manual  auid  two  of  the  automatic  test  optics. 

curing  Day  1  testing,  the  two  ditplay  test  options  and  the  first  seven  procedural 
cptions  described  in  section  2.3.2  were  conbined  to  produce  seven  Data  Link  test 
conditions.  In  addition,  an  option  was  created  as  a  conparative  baseline  in  which 
the  subjects  were  required  to  control  the  traffic  in  the  test  scenario  using  current 
procedures.  All  ei^t  conditions  were  presented  in  10-minute  scenarios  in  the  order 
listed  below: 

1.  Baseline 

2.  Voice  -  Manual  -  Pilot  Response  Required  -  PVD  Dr^lay 

3.  Voice  -  Manual  -  Pilot  Respcaise  Required  -  C3®  Display 

4.  Voice  -  Manual  -  No  Pilot  Respcxise 

5.  Voice  -  Automatic  -  Pilot  Response  Required 

6.  Voice  -  Autcinatic  -  No  Pilot  Reqpcsise 

7.  No  Voice  -  Automatic  -  Pilot  Respcanse  Required 

8.  Modified  System 
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As  shown  above,  cxjnditicxis  2  and  3  were  prooedurally  identical  in  order  to  permit 
an  unocxifounded  ocrpariscxi  of  the  PVD  and  CK)  di^lays.  Conditions  4  throucfi  8 
were  ocnducted  with  the  dL^lay  selected  by  the  controllers  eifter  corapleting 
oonditicxTs  2  and  3.  In  all  cases  the  subjects  chose  to  perform  the  last  five 
conditiOTS  using  the  IVD  di^lay. 

During  testing,  two  ocxTtrollers  were  assigned  to  each  of  the  four  sector  work 
staticMis  in  the  Data  Link  test  bed.  One  of  the  controllers  actively  performed  the 
ATC  tasks  required  in  the  test  script.  The  second  controller  acted  as  a  passive 
operaticxial  observer.  During  the  15-minute  periods  that  ela^ssed  between  testing 
ccHiditicxTs,  both  the  active  and  passive  controllers  ccnpleted  the  rating  forms  for 
the  raoswAT  workload  and  preferenoe/aooeptability  sccdes. 

Primary  test  personnel  responsible  for  the  formal  data  collection  included  the  data 
link  facilitators  and  the  DYSIM  pilots.  One  Data  Link  facilitator  was  assigned  to 
each  of  the  four  active/passive  controller  teams.  These  individuals  were 
responsible  for  ail  controller  training  as  well  as  subject  guidance  during  testing. 
The  subject  guidance  included  explanation  of  the  options  to  be  tested  during  each 
condition,  using  the  scenario  script  to  cue  the  subjects  regarding  the  type  of  ATC 
service  to  be  delivered  and  the  time  at  vhich  it  should  be  delivered  during  the  data 
collection  runs,  and  aiding  the  subjects  in  acoocplishing  the  appropriate 
procedures. 

The  four  DYSIM  pilots  acted  as  simulation  pilots  during  training  and  testing.  They 
were  seated  at  additional  work  stations  in  the  test  bed  which  were  oraifigured  to 
permit  control  over  the  simulated  aircraft  in  the  scenarios.  One  DYSIM  pilot  was 
assigned  to  provide  all  radio  re^xjnses  and  Data  Link  inputs  to  each  sector. 

Following  the  Day  1  formal  data  collection,  the  ei^t  subjects  and  the  two 
controllers,  vho  informally  observed  the  data  collection  runs,  attended  a  groip 
debriefing  sessiOTi.  This  debriefing  was  stnx:±ured  by  presenting  the  controllers 
with  a  series  of  questions  cn  individual  overhead  projection  slides.  Each 
controller  was  given  a  printed  copy  of  the  slides  in  order  to  record  his  response 
and  consents.  Open  discussion  of  the  topics  and  questi(^is  raised  in  the  debriefing 
was  encouraged,  and  resulted  in  a  grocp  cmsensus  for  a  modified  test  omditicxi  to 
be  evaluated  during  Day  2  formal  testing. 

On  Day  2  of  testing,  the  modified  procedural  opticxi  described  in  section  2. 3. 2. 2. 6 
was  tested.  The  modified  test  condition  was  run  twice  in  order  to  permit  all  ei^t 
subjects  to  actively  participate.  Each  ooTtroller  coitpleted  the  workload  and 
preferenoe/acc^jtability  scales  for  this  modified  system  opticxi  after  the  test  run. 

In  a  final  debriefing  session  on  Day  2  the  subjects  conpleted  a  wrap-vp 
questionnaire  and  wrote  individual  narrative  ocrroents  on  their  preferred 
configurations  for  the  Data  Link  services. 

2.3.5  Data  Ool^  ectiOTi . 

Five  different  instruments  were  used  during  this  stu^  to  acquire  data  from  the 
subject  ccxTtrollers  regarding  the  tested  services  and  the  data  link  concept:  (a)  the 
BROGW^  workload  scale,  (b)  a  ccsitroller  preferenoe/aoo^xtability  scale,  (c)  a  groip 
discussion  ddoriefing,  (d)  a  wrcp-ip  questimnaire,  and  (e)  a  written  narrative 
descripticMi  of  the  preferr^  system  ccnfiguration. 
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Formal  data  cx)llectiai  cai  the  Data  Link  test  bed  was  cxmducted  using  the  PRDSWAT 
workload  scale  and  a  preferenc3e/aooeptability  scale.  Pollcwing  each  test  run  the 
subjects  were  asypH  to  project  the  workload  that  would  be  experienced  for  each 
service  on  a  moderately  busy  work  day  if  the  display  and  procedural  option  were 
used.  The  ERDSWAT  technique  used  by  the  controllers  to  rate  the  projected  workload 
required  them  to  check  the  e^ropriate  descriptor  on  each  of  three,  S^xsint  sccdes. 
The  individual  scales  refer  to  time  load,  the  level  of  mental  effort  required,  and 
the  degree  of  psychological  stress  ejqjerienced.  A  sanple  of  the  form  used  to  make 
the  FRDSWAT  ratings  and  a  ccnplete  scale  with  formal  descriptions  of  each  level  are 
COTitained  in  appendix  B. 

The  three  ordinal  level  ratings  obtained  frcm  a  subject  for  each  service  were 
transformed  to  a  single  interval  value  ranging  frcm  0  to  100  on  a  cxxitoined  workload 
scale.  The  mapping  of  the  time,  effort,  and  stress  ratings  to  the  ccntoined  scale 
was  determined  through  conjoint  measurement  and  scaling  anedysis  of  the  EROSVIAT  card 
sorts  performed  by  the  test  subjects  prior  to  data  collection.  A  description  of  the 
conjoint  scaling  method  and  a  copy  of  the  instructions  used  to  guide  the  cxaitroller 
subjects  in  the  card  sor'ting  task  are  included  in  appendix  B. 

After  completing  the  ERDSWAT  ratings  for  each  test  option,  the  subjecrts  were  edso 
required  to  rate  the  acxjeptability  of  eexti  test  csption.  The  form  used  to  make 
these  ratings  is  also  contained  in  appendix  B. 

This  form  actually  required  the  subjects  to  make  two  ratings.  First,  the 
controller  judged  vhether  or  not  an  option  was  acxseptable  in  terms  of  ATC  safety 
and  efficiency.  If  the  cpticxi  was  rated  *’<xnpletely  unacceptable"  for  any  service, 
the  rating  was  terminated.  However,  if  the  option  was  acceptable,  the  controller 
provided  a  prefereroe  rating  cxi  a  7-point  scale  ranging  from  1  (highly  preferred)  to 
7  (aoc^Ttable,  but  not  preferred) .  The  data  collection  booklet  in  vhich  the  rating 
scciles  were  bound,  provided  ^xioe  for  the  controller  to  write  brief  ccnments 
explaining  the  rationale  underlying  each  preferenoe/aa^eptability  rating. 
Instructions  to  subjects  for  using  the  preference/  acceptability  scales  eanphasized 
that  the  ERD6WAT  and  preference  ratings  should  be  made  independently  since  the  two 
dimensions  cire  not  necesscurily  correlated. 

The  remaining  three  assessment  instruments  used  in  this  mini  stuc^  were  employed 
during  the  debriefing  sessicns  vhich  followed  the  formeil  data  oollectiai  in  the 
test  bed.  On  Day  1  of  testing,  the  d^riefing  was  cxxxiuc±ed  in  a  grxxp  discussico 
format.  The  sessican  was  structured  using  a  series  of  overhead  projecticai  slides 
(see  appendix  C) .  Each  slide  cxxitained  a  single  question  for  groip  discussion.  The 
controllers  were  supplied  with  printed  copies  of  the  slides  in  order  to  record 
individual  comments. 

The  topics  covered  in  the  debriefing  slides  included  specific  questicxis  about  the 
services  under  evaluation,  the  effects  of  operationed  variatic»is  on  the  selection 
of  appropriate  procedures,  preferred  di^lays  and  procedures,  and  general  issues 
related  to  the  utility  of  the  Data  Link  concept. 

The  last  two  measurement  techniques  were  enplpyed  during  the  debriefing  sessicn 
vMch  followed  Day  2  testing.  The  first  part  of  this  session  was  devoted  to  the 
conpletion  of  a  wrap-vp  questionnaire.  The  questionnaire  covered  issues  relating 
to  the  adequacy  of  the  simolaticxi  and  controller  measures,  the  operaticxial  value  of 
the  service  di^lays  and  procedures  tested,  the  effects  of  Data  Link  on  various 


aspects  of  controller  performanoe  and  suggested  future  services  for  iitpleaientation 
on  Data  Link.  A  copy  of  the  wrap-up  questiamaire  is  oxitained  in  appendix  D. 

During  the  Day  2  d^riefing  session,  each  ocxTtroller  was  asked  to  write  a  final 
narrative  description  of  his  preferred  design  for  each  service.  The  purpose  of 
this  exercise  was  to  capture  any  individual  ccnnents  and  suggestions  that  mi^t  not 
have  been  elicited  during  the  previous  day's  grocp  format  discussions. 

2.3.6  Data  Reduction  and  Analysis. 

Ratings  of  ocxitroller  wor3cload  and  preferenoe/aoo^jtability  were  ancdyzed  using 
standard  tests  of  statistical  significeuxe  appropriate  to  the  measurement  scale 
characteristics  of  the  data  collected.  Because  of  the  interval  scale  nature  of  the 
PROSWAT  scores,  these  data  were  analyzed  using  parametric  tests.  All  option 
combinaticxis  were  ocnpared  using  a  single  factor,  r^^eated  measures  analysis  of 
variance  (ANOVA) .  One  ANOVA  was  run  for  each  of  the  three  services  to  evaluate 
overall  significance  of  differences  in  projected  workload  produced  by  the  test 
conditions.  Post-hoc  student's  t  tests  for  correlated  saitples  were  used  to 
evaluate  the  significance  of  individual  and  ocmbined  group  mean  differences 
relevant  to  the  design  issues  under  investigaticxi. 

Since  the  preferenoe/aoceptability  rating  data  held  ordinal  scale  ciaracteristics, 
they  were  treated  using  norparametric  methods.  Overall  significance  tests  were 
performed  using  the  Friedman  TVro-Way  Analysis  of  Variance  by  Ranks.  Pcjst-hoc 
nonparametric  ocrparisons  equivalent  to  the  workload  t  tests  were  performed  using 
Wilcoxon's  test. 

The  7-point  rating  data  obtained  from  a  portion  of  the  wrap-up  questionnaire  were 
evaluated  using  a  Student's  t  procedure  designed  to  evaluate  the  significance  of 
differences  in  ratings  from  the  scale  mic^int  and  from  the  grand  meeui  ratings. 

All  remaining  questionnaire  euxi  neurrative  re^xxises  obtained  for  the  preference 
comments  and  from  the  ciebriefing  sessicxis  were  sunmarized  to  provide  cxncise 
descaripticsTs  of  the  types  and  frequency  of  occurrenca  for  each  coment  received. 
In  all  cases,  the  goed  of  these  descriptive  aralyses  was  to  determine  the  strength 
and  directicxi  of  cxintroller  opiniois  regarding  the  study  issues. 

3.  TEST  RESULTS. 

The  detailed  results  obtained  with  each  of  the  meeisurement  methods  employed  in  this 
mini  study  are  contained  in  Volume  II  of  this  r^ort.  Ihe  analyses  of  the  IROSWAT 
card  sorts  and  the  results  for  the  FROSWAT  workload  and  preference/acx!^>tability 
ratings  are  presented  in  appendix  E.  Ihe  anedysis  of  the  Day  1  group  debriefing 
results  are  presented  in  appendix  C.  Appendix  F  cxxitains  the  analyses  for  the 
wrap-ip  questionnaire  and  appendix  G  presents  a  summary  of  the  final  written 
reirrative  cxxtments. 

This  secticxi  of  the  r^»rt  draws  upon  the  cxxitents  of  edl  of  the  cJetailed  results 
to  address  the  findings  vhich  are  pertinent  to  each  of  the  following  topics. 
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3.1  SPECIFIC  RESUIIS  REGARDING  THE  CESIQJ  OF  THE  THREE  INITIAL  ATC  SEB^/ICES. 

3.1.1  T.ink  Controller  Displays. 

The  cxxnbined  assessment  methods  used  in  this  stu^  provided  consistent  results 
regctrding  the  appropriate  transaction  di^lay  for  the  tested  services.  As  shown  in 
figure  3,  mean  FROSWAT  workload  scores  were  lower  for  the  PVD  di^lay  than  with  the 
peripheral  di^lay  for  the  edtitude  canfirmatioi  and  transfer  of  ocranunication 
services.  No  effect  of  display  location  on  controller  workload  was  apparent  for 
E>ISAW. 

While  the  reosWAT  workload  differences  for  eill  three  services  were  not  statisticeilly 
significant,  the  preference  ratings  showed  a  statistically  significant  preference 
for  the  PVD  list  in  all  three  services  (see  figure  4) .  Aneilysis  of  controller 
cominents  regarding  their  preference  ratings  indicated  that  eill  eight  subjects  felt 
the  PVD  list  was  si:?jerior  because  the  CRD  list  distracted  a  controller's  attention 
frcsn  the  primeury  ATC  display.  The  subjects  eilso  noted  that  the  CRD  list  was  not 
accesible  by  trackball  inputs,  would  produce  cc»igestic»i  tai  this  di^lay,  or  would 
itake  it  unavailable  for  presentation  of  aircraft  beacon  codes. 

Results  from  the  Day  1  grot^j  debriefing,  the  wrap-v?5  questionnaire,  and  the  final 
narrative  cements  fully  stpported  the  overvhelming  subject  preference  for 
displaying  primary  Data  Link  informaticxi  oti  the  FVD  list.  However,  cinalyses  of 
these  results  edso  indicated  a  straig  CMitroller  preference  for  further  enhancement 
of  Data  Link  displays.  General  preference  cements  on  the  tested  displays  expressed 
a  concern  that  the  list  format  display  may  beoane  difficult  to  monitor  and  interpret 
when  multiple  aircraft  and  services  are  r^resented.  Furthermore,  these  cements 
indicated  that  the  list  display  may  detract  the  ccntroller's  attention  from  the 
principal  aircraft  radar  data  on  the  PVD. 

Subject's  suggesticans  for  alleviating  these  problesms  were  derived  from  cements 
obtained  during  both  <M)riefing  sessions.  The  fined,  narrative  cements  indicated 
that  a  majority  of  the  ocaitrollers  would  prefer  seme  form  of  Data  Link  transaction 
display  in  the  data  blocks  an  the  PVD.  Such  a  display  could  take  the  form  of  a 
single  character  code  timesharing  with  other  data  block  information  that  would 
indicate  the  status  of  a  particular  service  transacticn  (e.g. ,  "W"  for  WILOO) . 
AlthoLK^  no  controllers  indicated  that  all  Data  Link  transaction  data  should  be 
presented  in  the  data  block,  the  general  consensus  appeared  to  be  that  for  the  type 
of  services  tested  in  this  study,  the  data  block  should  be  used  for  ensuring  that 
messages  have  been  transmitted  and  received  by  the  appropriate  aircraft.  Alternate 
PVD  list  displays  may  be  preferable  for  ncncritical  pilot  downlinks  and  Data  Link 
menus. 


3.1.2  Ccntroller  Procedures  for  Altitude  Confirmation.  Transfer  of  Ocmunications. 
and  TMSAW. 

The  results  for  the  options  tested  in  this  study  yielded  a  strong  level  of 
agreement  regarding  the  most  suitable  procedures  for  providing  eill  three  of  the 
tested  services.  The  largest  measured  iitpact  oi  ocsTtroller  workload  that  was 
detected  during  the  tests  was  produced  by  corpariscsTs  between  the  manual  and 
automatic  opticMis  (see  figure  5) .  FROSWAT  workload  scores  were  significeintly 
hi^er  in  the  manual  tplink  versions  of  the  procedure  than  in  the  automatic 
versions.  All  three  services  were  edso  more  highly  preferred  when  the  automatic 
mode  was  used  (figure  6) . 
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PVD  CRD  PVD  CRD  PVD  CRD 

ALTITUDE  TRANSFER  OF  eMSWV 
CONFIRMATION  COMMUNICATIONS 


FIGURE  3.  DATA  LINK  CONTROLLER  WORKLOAD  DISPLAY  LOCATION 


FIGURE  4.  DATA  LINK  CONTROLLER  PREFERENCE  DISPLAY  LOCATION 


ALTITUDE  TRANSFER  OF  EM8/W 

CONFIRMATION  COMMUNICATIONS 


FIGURE  5.  DATA  LINK  CONTROLLER  WORKLOAD.  MANUAL  VS.  AUTOMATIC  UPLINK 
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MEDIAN  PREFERENCE  RATING  (INVERTED.  8-R) 
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gonpiiTEiY  ALTITUDE  TRANSFER  OF  EM8RW 

UfMceimLE  CONFIRMATION  COMMUNICATION 


FIGURE  6.  DATA  LINK  CONTROLLER  PREFERENCE.  MANUAL  VS.  AUTOMATIC  UPLINK 
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The  preference  ocranents  indicated  that  the  effect  of  autcmaticai  was  primarily  due 
to  the  difference  in  data  entry  requirements  for  the  two  versions.  Additional 
iiqprovements  in  workload  and  preference  were  gained  vtien  these  keyboard  entries 
were  reduced  even  further  in  the  modified  system  option  evaluated  on  Day  2  of 
testing.  In  this  case,  both  the  data  entry  required  to  designate  and  send  an 
iplihk  and  the  entries  necessary  to  delete  ocnpleted  transactic^  lines  frcm  the 
display  were  reduced. 

Analysis  of  subject  cGrments  from  the  ddoriefing  sessions  showed  that  althcuc^  the 
autcmatic  vplihk  was  preferred  for  edl  services,  the  ^rstem  should  be  ehhartced  by 
permitting  ccntrollers  to  gain  additionad.  control  over  the  initiation  of  an  v^jlink. 
The  most  ocmiiDn  suggestion  for  providing  this  control  was  an  "inhibit"  function.  In 
this  Ccise,  the  x:plink  would  be  automatic  unless  the  controller  entered  a  single 
character  prefix  to  an  altitude  amendment  or  hand-off  ccnputer  entry  vhich  would 
hold  the  message  for  future  i;plink.  Other  suggestions  included  a  set  of  single 
chairacter  entries  which  would  send  data  to  the  NAS  only,  to  the  NAS  and  the  pilot, 
or  to  the  pilot  cxily.  The  i;plink  inhibit  function  was  considered  necessary  by  most 
COTTtrollers  in  order  to  permit  handling  of  delayed  transfer  of  oomunication  after  a 
hand-off. 

Controller  workload  and  preference  were  also  enhanced  for  all  three  services  vhen 
the  procedures  were  cxnducted  without  voice  oonirunicaticxis  between  the  pilot  and 
the  controller,  vhich  were  redundant  with  a  Data  Link  transaction.  As  shown  in 
figure  7,  FROSWAT  workload  scores  were  ocxisistently  hi^ier  in  the  voice  test 
conditions.  This  effect  was  hiq^y  significant  for  the  altitude  confirmaticai 
service,  and  similar  trends  were  observed  for  the  other  services.  The  preference 
ratings  were  significantly  hi^ier  for  the  no  voice  conditions  in  all  cases  (figure  8) . 

Preference  ocnments  and  debriefing  re^xxises  eigreed  with  the  rating  data  and 
indicated  that  normal  Data  Link  transactions  should  be  conducted  without  voice 
after  an  initial  transition  period. 

The  requirement  for  a  downlinked  pilot  re^xxise  in  the  Data  Link  procedure  for  the 
three  services  hcKi  an  equivocal  effect  on  controller  workload  and  preference.  No 
statisticcilly  significant  effect  of  requiring  the  downlinked  ocaifirmation  on 
controller  workload  was  detected  in  conditions  vdiere  the  icespcmse  was  redundant 
with  a  voice  connunication.  The  preference  data  indicated  a  sli^t  controller  bias 
for  the  no  re^xonse  option  in  these  oxiditions.  However,  this  was  statistically 
significant  cxily  in  the  automatic  versicxi  of  the  EMSAW  service. 

V^hen  assessed  in  reference  to  the  clearly  superior  ratings  assigned  to  ed.1  no  voice 
conditions,  these  ncxisignificant  findings  c^pear  to  indicate  only  that  some  type  of 
pilot  confirmaticai  is  required,  either  by  voice  or  Data  Link,  and  that  a  data  linked 
re^xxise  is  both  aoc^jtable  and  preferable.  This  conclusion  was  ccxifirmed  by 
ocxitroller  re^xxises  to  the  d^riefing  interview.  All  nine  of  the  responding 
subjects  indicated  that  a  downlink  would  be  a  preferable  method  for  ccxtfirming  the 
receipt  of  a  Data  Link  message. 

The  optimality  of  the  procedures  suggested  by  the  data  reviewed  above  was  confirmed 
by  conparing  the  workload  and  preference  scores  obtained  in  the  autcmatic/no  voice 
and  the  modified  systan  conditions  with  edl  of  the  other  tested  options.  In  the 
case  of  each  service,  those  test  oonditicxis  vhich  most  closely  apprmcimated  the 
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MEAN  PROSm*  SCORE 


ALTITUDE  TRANSFER  OF  EM8RW 

CONFIRMATION  COMMUNICATIONS 


FIGURE  7.  DATA  LINK  CONTROLLER  WORKLOAD,  REDUNDANT  VOICE  COMMUNICATIONS 


19 


preferred  configuration  produced  the  hi^iest  preference  scores  and  the  lowest 
projected  workload  estimates. 

Althou^  the  subject  controllers  selected  identical  optimum  displays  and  procedures 
for  the  three  services  tested,  noteworthy  ccranents  regarding  the  design  of  the 
individual  services  were  elicited  in  the  (M}riefing  session.  In  particular,  the 
controllers  indicated  that  the  transfer  of  ocranunications  service  must  present  Data 
Link  di^lays  to  both  the  transferring  and  receiving  controllers,  and  that  the 
uplink  of  the  new  RF  should  be  under  control  of  the  transferring  ccaTtroller  oily. 

Ihe  subjects  also  frequently  oonmented  that  the  EMSAW  service  was  a  cause  for 
concern.  Ihe  source  of  this  conoem  was  primarily  the  inpleroentation  of  EIGAW  with 
vAiich  they  were  familiar.  The  controllers  argued  that  this  inplementation  produced 
a  hi^  fcd.se  eilarm  rate.  In  additiai,  th^  felt  that  the  use  of  Data  Link  for  ElBAW 
^ould  be  further  investigated  with  ccntrollers  from  en  route  centers  which  contain 
more  terrain  obstacles  than  the  Dallas/Fort  Worth  area. 


3.2  GENERAL  RESULTS  ON  DATA  LINK. 


In  general,  the  subject  controllers  e^ressed  a  strongly  positive  opinic^  about  the 
potential  effects  of  the  Mode  S  Data  Link,  both  on  the  controller's  ta^  load  and  on 
the  overall  effectiveness  of  the  ATC  system.  Results  obtained  from  the  wrap-i;p 
questicmaire  indicated  that,  if  optimally  configured.  Data  Link  would  have 
overwhelmingly  positive  effects  on  workload,  system  capacity,  communications,  and 
overall  safety.  Specific  positive  aspects  of  Data  Link  mentioned  by  the  ccaitrollers 
in  the  debriefing  discussion  included  reducticxi  of  voice  congestion  and  reduction 
in  workload. 

The  final  narrative  coninents  elicited  at  the  end  of  the  stuc^  confirmed  the  hi^ 
level  of  acc^jtance  for  Data  Link.  A  significant  majority  of  the  subjects 
ind^)endently  noted  that  Data  Link  will  erhanoe  the  ATC  system. 

Very  few  negative  comments  regarding  Data  Link  were  generated  during  the  post-test 
sessions.  Hcwever,  two  controllers  did  express  a  ooncem  over  possible  variations 
and  delays  in  the  speed  of  Data  Link  transactions.  In  particular,  these  ccxitrollers 
felt  that  the  operational  version  of  Data  Link  will  have  to  operate  in  a  reliably 
rapid  fashicai  in  order  to  support  critical  positive  control  services. 

3.2.2  Automatic  vs.  Manual  Uplinks. 

As  described  in  secticHi  3.1.2,  automatic  uplinks  produced  significantly  lower 
workload  and  higher  preference  ratings  for  the  three  tested  services.  The  general 
ccaisensus  of  controller  renarks  in  the  preference  coninents,  debriefing  interviews, 
and  questic^maires  was  that  Data  Link  services  should  be  provided  in  an  automatic 
fashion  as  a  default  conditicn.  However,  they  also  agreed  that,  althou^  manual 
data  entries  should  be  minimized,  it  will  be  essentied  to  permit  manual  inhibition 
of  uplinks.  Most  of  the  subjects  sug^sted  that  this  be  acconplished  by  a  single 
character  prefix  to  a  transfer  of  control  or  edtitude  assignment  NAS  entry  vhich 
would  inhibit  the  uplink  umtil  released  by  a  second  entry. 
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Ihe  lack  of  preference  for  automatic  i;plinks  of  QSAW  es^ressed  by  some  subjects 
^years  to  have  been  the  result  of  a  oonoem  over  the  perceived  reliability  of  the 
current  EMSAW  function  rather  than  any  problem  with  Data  Link. 

In  general,  the  subjects  indicated  that  workload  reducticn  with  Data  Link  services 
will  be  aoccR^lished  only  if  the  system  permits  flexible  operation  with  the  minimal 
nuitber  of  controller  inputs  to  s&id  data  and  manage  the  list  of  Data  Link 
transacticns. 

3.2.3  Treatment  of  Pilot  Restxxises. 

Althouc^  the  results  of  the  workload  and  preference  ratings  revealed  only  a  minimal 
litpact  of  requiring  pilots  to  confirm  the  receipt  of  a  message  vising  an  overt 
downlink,  it  should  be  noted  that  the  ocnparison  of  the  pilot  re^xsnse  and  no 
re^xHise  oonditicxis  was  possible  cxily  in  cases  where  the  downlink  was  redundant  with 
pilot  voice  confirmation.  Both  conditions  in  vAiich  the  services  were  delivered 
automatically  without  voice  were  jvidged  preferable  by  the  controllers,  and  the 
downlinked  WIL30  was  considered  a  valid  method  of  confirming  message  receipt. 

Ihe  d^riefing  interviews  and  preference  ccnnients  did,  however,  suggest  that  the 
TIMElCUr  and  UNABLE  messages  nay  be  ine^ipropriate  labels  for  Data  Link  pilot 
responses.  In  the  ccise  of  a  TIMEOUT,  controllers  felt  that  the  verbiage  was 
vncleeu:,  and  that  NO  REPLY  wculd  be  a  better  indicator  of  a  pilot's  failure  to 
prcnpitly  acknowledge  an  vplink.  Ihe  UNABLE  downlink  from  a  pilot  was  also 
considered  inappropriate  since  this  type  of  re^xmse  to  a  positive  control 
instructicxi  would  not  be  acceptable  in  operational  settings.  In  both  of  the 
situations,  the  controllers  felt  that  the  most  appropriate  status  indicator  would 
be  a  salient  display  of  the  terms  CALL  or  VERIFY. 

3.2.4  Voice  in  Ooniunction  with  Data  rink. 

Ihe  workload  and  preference  data  collected  during  this  stuc^  clearly  show  that  the 
subject  controllers  felt  that  the  optimal  Data  Link  system  should  operate  under 
normal  ocnditions  without  redundant  voice  comnunications.  However,  the  debriefing 
data  eilso  indicated  that  Data  Link  will  continue  to  require  a  reliable  voice 
oonnunicaticns  system  as  a  backvp.  A  majority  of  the  controllers  noted  that  voice 
will  be  essential  to  deal  with  Data  Link  problems,  excessive  delays,  pilot 
oonfirmaticn  failures,  and  misunderstandings. 

In  general,  the  majority  of  cxxitroller  responses  to  the  grovp  debriefing  indicated 
that  the  future  ATC  system  would  be  best  operated  under  a  system  in  vhich  Data  Link 
is  the  primary  mode  for  most  messages  or  in  which  Data  Link  and  voice  are  assigned 
to  different  types  of  odmunications  tasks.  Furthermore,  the  svibjects  agreed  that, 
after  a  familiarization  period,  redundant  voice  and  Data  Link  transmissions  would 
defeat  the  primary  advantages  of  workload  reduction  and  productivity  enhancement 
that  are  offered  by  the  Data  Link  system. 

3.2.5  Additicnal  Carriidate  Services. 

Ihe  wrap-vp  questionnaire  and  final  narrative  ocnments  solicited  suggestions  from 
the  controllers  regarding  additicml  services  that  could  be  advantageously 
iirplemented  on  Data  Link.  Ihe  follcwing  is  an  abbreviated  list  of  the  most 
cnmmcnly  suggested  services: 
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a.  Downlihlc  of  Indicated  air^)eed,  macii  number,  grcundspeed,  and  heading. 

b.  Uplink  of  turns  (vectors) . 

c.  Uplink  of  field  10  (route)  amendments. 

d.  Ooded  standard  route  and  altitude  assignments  ocntnon  to  a  sector. 

3.3  EVAimnaj  of  mini  srupy  test  aebouacy. 

The  wr^>-i?>  questionnaire  and  final  discussions  also  gave  the  subjects  an 
opportunity  to  evciluate  the  utility  of  the  mini  stix^  and  the  procedures  vised 
during  the  test  conduct.  Ihese  coments  are  suninarized  YxIcm. 

3.3.1  Training  and  Simulatinn  f^iaTitv. 

Subject  coranents  regarding  the  type  and  adequacy  of  the  mini  study  training  were 
positive.  Both  the  preliminary  briefings  and  the  test  bed  leib  training  Mere 
cc^idered  useful.  Recognizing  that  the  intent  of  the  stucfy  was  to  provide  an 
austere  simulation  vhioh  focused  cxi  Data  Link  procedures,  the  mean  sidsject  rating 
of  the  realism  of  the  simulation  as  None  of  the  subjects  rated  the 

simulation  as  lower  than  "fair.'' 

3.3.2  Value  of  the  Mini  Study. 

The  final  narrative  coranents  and  an  open  discussion  conducted  at  the  raid  of  the 
test  provided  a  nuittoer  of  general  inputs  from  the  subject  controllers  regarding  the 
approach  underlying  the  mini  stucfy  and  directions  for  future  work.  Several 
coranents  were  received  that  indicated  that  the  subjects  regarded  the  stucty  as  an 
inportant  opportunity  to  make  inputs  to  the  design  of  Data  link  services.  Several 
controllers  noted  that  because  of  its  significance.  Data  link  should  have  a 
controller  evaluation  team  assigned  to  the  program  in  order  to  facilitate  further 
development. 

Finally,  when  asked  ^lecificEilly  about  the  value  of  the  mini  stucfy  format,  the 
controllers  strcngly  agreed  that  the  hands-on  evaluation  of  service  ofitions 
permitted  them  to  make  expert  judgments  about  the  Data  Link  design  that  Mould  not 
have  been  possible  vising  descriptive  materials  or  their  prior  knowledge  of  the 
system. 

4.  CmCIUSICTjS. 

Ihe  results  of  the  study  presented  in  this  report  warrant  a  number  of  ^lecific  and 
general  conclusions  about  the  Data  link  program  and  the  design  of  the  three  Air 
Traffic  Control  (ATC)  services  that  were  investigated: 

a.  Ihe  Mode  S  Data  Link  Systran  was  perceived  by  the  subject  controllers  as  an 
extremely  positive  ehhanoranent  to  the  ATC  system.  Ihe  inplementation  of  Data  link 
services  can  be  expected  to  reduce  controller  workload  and  voice  frequency 
ocxigestion  while  increasing  system  capacity,  safety,  and  efficiency. 

b.  Data  Link  displays  for  the  three  ATC  services  tested  in  this  stucfy  should 
be  centrally  located  and  easily  interpreted.  In  ccnparison  to  the  Oonputer  Readout 
Device  (CRD)  list,  the  Plan  View  Di^lay  (IVD)  list  tested  in  this  stuc^  was 
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preferred  by  ocntxollers  for  display  of  the  status  of  Data  Link  transactions. 
Rarther  inprovenent  viould  be  achieved  with  the  di^lay  of  criticzil  transaction 
status  information  in  the  full  data  bloc^. 

c.  Ihe  ^lecific  findings  of  the  stufy  indicate  that  controller  workload  will 
be  reduced  and  acoeptabilil^  enhanced  using  procedures  vhich  ninmize  the  nuniDer  of 
data  entries  required  to  acconplish  Data  Link  transactions.  Current  controller 
inputs  and  system  events  should  be  used  to  generate  Data  Link  messages,  and  status 
displays  should  be  automatically  deleted  upon  completion  of  a  Data  Link  transaction. 
As  few  keyboard  inputs  as  possible  should  be  used  to  transmit  and  manage  Data  Link 
services. 

d.  Automatic  message  vplinks  produced  lower  workload  and  were  more  preferable 
to  the  controllers  who  participated  in  this  stu^.  Hcwever,  a  clear  majority  of  the 
subjects  indicated  that  automatic  iplihks  should  be  a  default  condition.  Ihe  system 
must  permit  the  controller  to  inhibit  automatic  vplinks.  This  could  be  accomplished 
with  a  single  character  keyboard  iiput  as  a  prefix  to  a  system  edtitude  change  or 
transfer  of  control  entry.  Alternatively,  a  set  of  prefix  codes  could  be  used  to 
determine  the  destination (s)  for  any  entry  (e.g. ,  NAS  only,  NAS  and  aircraft,  pilot 
only) . 


e.  Voice  radio  comnunications  \ihich  are  redundant  with  Data  Link  transactions 
are  neither  necessary  nor  desirable  after  an  initiaO.  familiarization  period. 
However,  a  reliable  voice  link  must  be  maintained  in  parallel  with  Data  Link  for 
emergencies  and  for  resolving  misunderstandings. 

f.  A  downlinked  pilot  response  is  essential  \(hen  voice  conmunications  are 
eliminated  from  Data  Link  transactions,  unambiguous  aircraft  and  pilot  responses 
should  be  used  to  indicate  ocnplianoe.  Data  Link  fadlvire,  or  misunderstandings. 
Voice  conmunications  should  be  \ised  to  resolve  transactions  which  do  not  result  in  a 
pilot  WIKX). 

g.  The  subject  controllers  were  least  oert2dn  about  appropriate  methods  for 
providing  the  EM5AW  service  via  Data  link.  EM5AW  accuracy  and  reliability  issues 
produced  some  objections  to  automatic  uplink  of  this  service. 

h.  Data  Link  transacticxi  time  and  time  variability  was  a  concern  to  some  of 
the  subject  ocxitrollers.  Positive  AFC  functions  will  require  contact  with  an 
aircraft  and  a  definitive,  easily  interpreted  response  within  a  time  period  that  is 
ocnparable  to  current  voice  conmunications. 

i.  The  subject  ocxitrollers  concurred  that  the  approach  and  assessment  methods 
enplcyed  in  the  mini  study  format  were  e^ropriate  and  valid  for  achieving  the 
research  goals  of  identifying  a  minimized  set  of  acceptable  design  options  for  the 
operaticxial  evaluaticxi  stage  of  the  Data  Link  program. 

j.  The  results  of  this  study  were  positive,  hic^y  definitive,  and  were  not 
fully  predictable  prior  to  the  start  of  data  collection.  In  addition,  r^id 
reconflguratioi  of  the  Data  Link  test  bed  made  it  possible  to  design  and  test 
procedures  based  on  controller  inputs  that  were  provided  within  the  context  of  the 
study.  This  resulted  in  significant  progress  toward  the  definition  of  useful 
controller  procedures  that  mi^t  not  have  be^  achieved  under  other  circumstances. 
For  these  reasons,  it  is  essential  that  continued,  regular  involvement  of  field 
controllers  be  an  integral  part  of  the  accelerated  Data  Link  development  effort. 
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The  results  and  cxxiclusions  of  this  study  are  the  basis  fca:  the  recxnnendations 
listed  belcw.  Ihese  recxnnendations  are  intended  to  guide  preliminary  cxxitroller 
procedure  and  interface  designs  for  the  initial  pacikage  of  Data  Link  Air  Traffic 
Control  (ATC)  services,  and  to  identify  ifsues  and  s^proaches  relevant  to  the 
cxxiducrt  of  future  controller  evaluation  research  on  Data  Link  explications. 

a.  Ihe  findings  of  this  mini  study  indicate  that  the  altitude  confirmation, 
transfer  of  comnunicaticxis,  and  En  Pouta  Minimum  Safe  Altitude  Warning  (EMSAW) 
services  should  be  configured  acxxirding  to  the  following  general  qiecificaticxis  for 
the  full  scale  operaticxal  evaluation  study: 

1.  The  Data  Link  transacticxi  list  display  should  be  located  cxi  the  Plan 
View  Di^lay  (FVD) .  It  is  also  strongly  reocmnaided  that  a  display  of  the  current 
status  of  each  transacticn  be  placed  in  the  full  data  blcxdc.  This  single  character 
cxxie  may  be  time  shared  with  other  ciata  blcxdc  information  and  should  indicate  the 
availability  of  a  message  for  ix>link  as  well  as  the  cxxurrenoe  of  a  confirmatory  or 
failed  response.  Acceptable  cxxling  characters  and  Icxetions  for  this  display  in  the 
data  block  are  cxxrtained  in  the  expendixes  descxibing  the  detailed  results  of  this 
report. 

2.  Data  Link  messages  should  be  prepared  automatically  and  transaction 
list  entries  should  be  deleted  automatically  follcwing  a  successful  uplink  and 
pilot  cxxifirmation.  In  additicxi  to  providing  track  bedl  acxess,  list  entries 
should  be  labeled  by  single  character  cxxles  to  enable  designation  of  an  entry  with  a 
single  key  stroke. 

3.  Uplinks  should  be  automatic  unless  a  prefix  cxsde  is  used  vhen  entering 
an  edtitude  or  conpleting  a  hand-off  to  iihibit  the  uplink.  Controller  suggesticxis 
for  these  prefix  codes  are  cxntained  in  the  cietailed  results. 

4.  Because  of  remaining  cjuestions  regarding  the  DGAW  service,  both 
automatic  and  nemual  vplinks  should  be  available  as  test  opticxis  in  the  operaticxial 
evaluation  study. 

5.  After  an  initieil  familiarizaticxi  pericxi,  redundant  voica  radio 
cxmnunications  should  not  be  used.  However,  i^jecific  protocols  regarding  the  use 
of  voice  should  be  developed  to  standardize  the  resolution  of  emergency  system 
failures  and  fedled  \xi/downlinks.  These  should  ^ocify  the  cxxiditions  under  vhich  a 
message  should  be  retransmitted  using  Data  Lirk  and  those  in  vhich  an  inmediate 
voice  radio  contact  should  be  made. 

6.  Downlinked  pilcTt  re^xose  should  be  mandatory  for  each  service. 

7.  The  transfer  of  ocxniuniceticns  service  should  di^lay  transac±ice 
status  informaticxi  to  both  the  transferring  and  receiving  controllers.  However,  the 
service  transmissicxi  should  be  under  the  exclusive  cxntrol  of  the  transferring 
secctor. 


b.  Additioned  iiputs  frcn  en  route  oontrollers  are  recxomended  to  resolve 
questicns  regarding  the  inftlenentaticn  of  EM5AW  cn  Data  link.  ^)ecd£ic8dly, 
ocntrollers  should  be  ocnsulted  viho  operate  fixn  centers  covering  mountainous 
terrain. 


c.  Because  of  the  accelerated  status  of  the  program  and  the  valuable  data 
which  were  collected  in  the  current  stucfy,  it  is  reccmnended  that  a  national  team 
of  edr  traffic  controllers  be  e^pointed  for  continued  input  to  Data  Link  controller 
design  and  evaluation  efforts. 
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